Haunted by this? Getting mysterious NullPointerExceptions in your BeanPostProcessors?
I have written a lengthy answer how to debug and solve these issues on stackoverflow.com.
Haunted by this? Getting mysterious NullPointerExceptions in your BeanPostProcessors?
I have written a lengthy answer how to debug and solve these issues on stackoverflow.com.
It’s a fact that the majority or the “obvious” is often wrong. During World War II, groups of engineers tried to figure out how to best reinforce airplanes to reduce losses of life and material. For this, a study was conducted about the kind of damage planes showed as they returned to base. The general consensus was that the spots with the holes were the places which needed reinforcement.
The mathematician Abraham Wald objected and argued to reinforce all the other places. If you wonder what’s wrong with this guy, consider this: These were the airplanes that had returned. So the holes must be in places where the plane could sustain some damage. Which means the other, the lost planes must have been hit elsewhere.
When Bill Bartmann founded CFS2, ” a debt-collection company based in Tulsa, OK,” he faced a similar issue. Most debt-collectors threaten their … err … victims? Bill found that a pretty stupid strategy. Why not help the indebted to make money? Like as in enabling them to pay the debt?
As the Wikipedia article states:
Counter-intuitively CFS2 offers a unique array of free services to those they are collecting from, including: employment assistance,[16] credit specialists who negotiate reductions of other personal debt, resume writing, medical discounts and help accessing government assistance.
One of the results: This enables “CFS2 to collect at rates twice the industry average.”
See? Being nice does pay off!
Here is the list of blog posts about all the talks that I attended at Jazoon 2013:
In his talk “Successful Collaboration in Agile Software Teams,” Martin Kropp lists the key factors for collaboration in agile software teams. (slides on slideshare)
For me the most important points were (slide 6):
“Agile collaboration is …
No is no “Agile by the Book.”
After that, he lists the usual pain points:
Modern technologies like large touchscreens will make things better (slide 23).
A word about open-plan offices: They are the best tool to reduce productivity. See these articles to learn why:
If you’re small, scalability is not an issue. If you’re big, you can plan for it. But what if you wake up one morning and you suddenly find you’ve become the next Google?
In his talk “The Economies of Scaling Software“, Abdelmonaim Remani talks about what scaling means, how you can plan for it (even if you don’t expect it to happen) and all the nasty details that stand between you and success (slides on slideshare).
Today, the ubiquity of the Internet has blurred the lines between consumers and enterprises. They start to ask the same questions which eventually all boil down to: “How can I find what I’m looking for in a universe of haystacks?”
One day, many of us will find themselves with the need to scale because the performance of the old solution has become unbearable and all low-hanging fruit (faster CPU, more RAM) have been picked.
To solve this, you can look at the CPU (slide 16-35) or you can start to build clusters (36-45).
Or your I/O might be the bottleneck (slides 46-60). You can solve this by looking at NoSQL databases and caching.
Is the network the problem? (slides 61-75) Start with asynchronous processing, batch jobs, content delivery networks (CDN), DNS sharding or use a different protocol to connect the various parts of your system.
But how do you know what part is the bottleneck? The answer here is monitoring. (slide 77)
Note that scaling often helps with disaster recovery, you still have to plan for it – if all nodes of your cluster are in the same room, it’s still a single point of failure (slide 79)
Software isn’t everything. Don’t forget your team (slide 82)
Heather VanCura explained how the new JCP works in her talk “Join the Java Evolution; JCP & Adopt-a-JSR” (slides on slideshare)
Oracle spent the last years to make the JCP much more open and accessible. One example here are the JSRs which are much more lightweight than the complex JCPs. You can even adopt one.
Maybe you’re a long time joda-time user and want to make sure important features make it into JSR 310 – new Date and Time API for Java? Join them to discuss your need, share some code, help write, improve or translate documentation.
Some bug in the SDK nagging you? Contribute a fix to the OpenJDK. With Java 8, the OpenJDK build has been simplified tremendously. Sun ignored your bug report for years even though it contained a patch? Now is the time to change this.
I had the chance to chat with Heather after the talk which earned me a copy of “Java 7 Concurrency Cookbook”; thanks for that 🙂 We discusses a couple of ideas and she gave me points; maybe I’ll submit a few patches. If I do, I’ll blog about the experience here.
When using git, you really have to define a workflow that you want to use. In his talk “Real World Git Workflow” (slides on slideshare), Stefan Saasen explains some kinds of workflows and when they are appropriate.
The first step in any workflow design is asking questions. Some examples that will sound familiar:
Your questions will be different but make sure you ask them. There is no perfect workflow but there is your workflow. Omit this step at your own peril.
First, which collaboration model do you use?
“Anarchy” (anyone can push anywhere, slide 17), “Gatekeeper” (one person reviews all changes, often used by OSS projects, slide 18), “Dictator and Lieutenants” (Linux, slide 19) or “Centralised” (slide 20). See also “Git Workflows” on atlassian.com/git.
In the enterprise, the centralized model is often used. This approach makes it most simple to integrate all the tools (CI servers, code quality tools, deployment, …). (slide 23)
The two most common branching models are “continuous delivery” and “product releases.” (slide 25)
From slide 28:
“Significant branches map to a concept in the outside world. It may be a past release, an environment or a role. Those branches are long-running and stable whereas feature branches are short lived and volatile.”
– Stefan Saasen
Slide 27 shows the branches for “continuous delivery”. PR is a “pull request.”
As you can see, development is consolidated in the staging branch and pushed into production (master branch) from there. If you make a hotfix in the master branch, it is cherry-picked back into staging.
Slide 30 shows how to handle “product releases.” You have a single, central repository with a master branch which consolidates the development (no staging). Each feature and bugfix happens in a short-lived “feature branch.” When a release is made (slide 31), then a new long living release branch is created. Bug fixes still happen in short lived branches.
When the bug is fixed, the fix is first merged back into the oldest affected release. From there in the next release until you get to the latest release from which it is then merged back into master (slide 33).
But what about changes you don’t want to merge like the changes made by the Maven release plugin? Maybe you will want to replace it with a better release workflow.
Or we use the correct git merge strategy: ours. This creates a new changeset with the merge information without actually merging anything. For git, it will look as if everything has been done and it won’t bother us with merging those changes ever again (slide 39).
While the above sounds reasonable, the question is why? What are the rules and forces which make this better? Stefan introduces “the merge protocol” to answer this. See slide 42 for this.
In a nutshell, you always try to merge more stable branches into less stable ones: Bug fix branch into branches where the bug hasn’t been fixed, yet. Features into branches which don’t have the feature.
That’s why you never merge master back into a release branch: Releases are most stable. You merge them into master. If you have fixed in master that you really need in a release, you cherry-pick them (slide 43).
A lot of people understand why code reviews would be a good thing, “but …” Sounds familiar? Then pull requests are for you.
Pull requests are an easy, low-overhead tool to have as much “code review” as you feel comfortable with. You can merge with by clicking a button or you can review the changes line-by-line. Your choice.
Most projects will use a single canonical repository but remote forks are useful, too. Imagine you have fixed an important (for you at least) bug in a OSS project. You send them a pull request but it’s rejected! What do you do?
You fork the project. git allows you to still track the changes made by the original project while isolating your life as much as you want (slide 52)
A fork is nice if you want to do an innovation spike – code that might never be included in the product. Fork instead of polluting the project history with dead experiments (53).
Some department needs big changes to some component? Fork it until the feature stabilizes. You can still merge them if you want, but you don’t have to (54).
Reduce the noise (55). A fork allows you to rewrite history.
You can use pre and post hooks to make everyone’s life easier. Use a local pre-commit or pre-push hooks to make sure some important tests have been run. For example, you could run FindBugs or checkstyle.
An interesting post-checkout hook would be to check whether the branch is green (66), i.e. code builds and all tests pass. Stop wasting time to search for bugs that were already there before you started your work. You can get this gem from bitly.com/green-builds (69).
The explosion of branches can quickly bog down your build server if you don’t come up with a strategy to handle this (71). Usually, it’s enough to build stable and master but developers will love it when they can manually trigger feature branch builds (72).
Guido Schmutz introduces two frameworks in his talk “Kafka and Storm – event processing in realtime” (slides on slideshare)
Apache Kafka is a publish-subscribe messaging system like JMS but more simple. Messages are kept in files and never deleted. Together with the fact that subscribers have to tell the system which message they want next, this means you can recover from bugs that corrupted your data even if you notice them only after some time: Just process all the corrupted messages again.
Storm is a “distributed realtime computation system. ” It makes it easy to define topologies (= graphs) of bolts (= places where a computation takes place) flowing your real-time data through a complex network to process, filter and aggregate it. Just like Akka, it defines all kinds of operations (filters, switches, routers, …) so you can easily and quickly build the topology you need. Trident makes this set-up step even more simple.
Compared to Hadoop, Storm is meant for real-time processing. Some projects combine the two.
If you need a good framework for serializing data in Java, have a look at Apache Avro.
“Rocket Propelled Java” is about being more productive by writing less boilerplate code (slides on slideshare).
In his talk, Andres Almiray showed some tools to make your code more compact while keeping or even improving readability.
The first one is lombok and lombok-pg which use Java annotations to generate a lot of boiler plate code (slides 3-6)
Similar, you can use Groovy AST transformations to create things like immutables or singletons correctly (“There are 5-6 ways to create singletons. Only two of them are correct”, slides 7-9)
Note: You might be worried to add Groovy to a pure Java project. You don’t have to. Just use it for the AST transformations to stop wasting time on writing code that only makes your compiler happy. Use Groovy as a “boilerplate code buster.”
If you ever wanted to use “Design by Contract“, GContracts is for you.
Tom Bujok listed a lot of methods, technologies and frameworks that you should be aware about in his talk “33 things you want to do better” (slides on speakerdeck)
At the beginning he reminded us how quickly a well designed system goes bad due to hurried changes. We need to be aware of our technical debt and we need to allocate time to spend on reducing it (slides 3-12).
As an example, car batteries are easy to find. They are a replacement part, designers and engineers make it easy to find. Compare this to the configuration of your project. If you need to change it, how easy is it to find the file that needs to be changed and then the place in the file?
Another important point is skills. In most other professions, you have some mastery of a skill before you use it. You train hundreds of hours before you play your first football game. In Software, we show you a computer, we show you the programming language of the year (not necessarily this year’s). There is no time to master the tools you have to use from day one (slides 13-15).
“We are what we repeatedly do; excellence then, is not an act but a habit.” – Aristotle
Or as Wikipedia defines it:
“Habits […] are routines of behavior that are repeated regularly and tend to occur subconsciously.”
Stop wondering why you always make the same mistakes – they’re habits. Eliminate them ASAP (slide 19):
Bad Habits – Katherine Murdock “The Psychology of Habit”:
- Recognize bad habits and eliminate them ASAP
- The older you get the more difficult it is to remove a bad habit
- Each repetition leaves its mark!
Turning bad habits into good ones – Dr. Michael Roussell, PhD.:
- You can’t erase a habit, you can only overwrite one.
- Insert the new habits into the current habit loops
Configure your IDE properly and remove bad defaults. Replace “ex.printStackTrace();” with “throw new RuntimeException(ex.getMessage(), ex);” (slides 43-45).
One bad habit is empty catch blocks with “can never happen” comments. If you see one during a code review, replace it with “System.exit(-1);”. It can never happen, right? Right? (slides 46-47).
Note: I have create a “ShouldNotHappenException” for this case 🙂
Another one is to make every method in a static helper class public. Maybe some of them can be package private? (slide 48)
Learn about other good habits. Read books like “Effective Java” (Joshua Bloch) and “Clean Code” (Robert C. Martin) (slide 49)
Use code reviews to notice bad habits and to spread knowledge in your team but prevent blame games. (slide 73)
Learn the keyboard shortcuts of your IDE (slide 78)
Remember (slide 79):
“Any jackass can kick down a barn, but it takes a good carpenter to build one.” – Sam Ryburn
Project lombok and lombok-pg – In a nutshell, these hook into the Java compiler and generate additional bytecode when certain annotations are present. Bored with getters, setters, hashCode() and equals() plus a nice toString()? Use @Data (slides 21-28).
Guava (slides 29-33)) is a great library with many tools that you have been missing in Java for years. You might also want to look at commons-lang.
Want to use lambda expressions but can’t upgrade to Java 8? Then lambdaj is for you (slides 34-39).
Logging? slf4j (40-42). Especially nice when combined with the @Slf4j annotation from lombok.
Bored to write all that boiler plate code to create all those services and managers that form your app? Look at Guice or Spring.
Use Spock to make tests more compact and easier to understand. (slides 50-52)
Unitils contains all the helper functions that we always missed in JUnit and Hamcrest (53-56).
JUnitParams will help you run tests with different parameters (57-59).
Need to wait for something during a test? Awaitility will help. (60-61)
When mocking isn’t enough and you need to inject code during a test, Byteman is the tool you want to look at (62-63)
Getting bored writing boiler plate code in Java to make a compiler happy? Have a look at Groovy. (64-67)
How about adding dependencies to your scripts? Try Grape. (68-69)
Is your build a mess? Do you feel Maven is too verbose or too limiting? Gradle might be for you. (70-72)
Version control is slowing you down? Have a look at Mercurial or Git (75)
Use bash or Python to automate man-/menial work. If you’re on Windows, look at Babun or Cygwin. (76-77).